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Field of the Invention 

The invention relates to an image processing method to detect 'tag" points in a tagged" 
S image of a sequence of images, said 'tags'' being the pattern observed on the 'tagged'' image 
resulting from the spatial modulation of the magnetization in the observed zone. The invention 
relates to every kind of modulation patterns that can be parameterized in the frequency domain. 
Tags can be, for example, straight tines on one modulation direction (SPAMM protocol), straight 
lines on several directions generating ever/ kind of grids (SPAMM protaxol) or generating radial 
10 patterns and circles of different diameters. In the following a tag would designate any kind of 
constitutive part of a larger pattern that can be parameterized in the frequency domain. Generally 
it would be a straight or a curved line at the beginning of a sequence, this line t)eing then 
deformed by the movement of the zone wherein the magnetization is modulated. Following the 
tag and its deformation is an issue of the Invention, 
15 The invention also relates to a computer program product wherein the method is 

implemented, to an image processing system and to an MRI apparatus to carr/ out the method. 
The invention finds its application in Magnetic Resonance Imaging (MRI). 

Background of the Invention 

20 A semi-automatic image processing method for detecting tag points is already known 

from a publication by M. Guttman et at. entitled 'Tags and Contour Detection in Tagged MR 
Images of the Left Ventricle" published in lEE Trans. Med. Imaging, 13:74-88, 1994. This article 
relates specifically to tag lines. As described in this publication, the user initializes tag line points 
and these points are followed by an algorithm based on a dynamic programming, which is guided 

25 by the user from an image to an other by using an intensity profile. The attribution of a point to a 
tag line is always checked by the user as a point could easily be affected to two neighboring tag 
lines. This method does not use any modeling of tag lines nor any predicted movements of tag 
lines. According to this known method, the image processing is slow and is consequently difficult 
to implement in view of diagnosis clinical applications. Moreover, since the algorithm is not fully 

30 autonomous for tracking the tag lines, this known method requires many user interactions for 
yielding a valid tracking of a tag line from an image to the following image. Besides, the accuracy 
of the detection of tag points is not validated by any analysis or movement reconstruction. 



Summary of the Invention 

It is an object of the present invention to provide an image processing niethod to fully 
automatically detect with accuracy tag points In an MRI image that is tagged according one 
modulation pattem as described in the introduction. 
5 It is to be noted that in an image of a sequence of images, each tag shows a motton from 

a current image to the following one. Current image being defined as the image of the sequence 
at time (t) wherein tag points are under detection, time t being incremented from the start to the 
end of the sequence. According to the invention, said motions of tags is taken into account. The 
motions of tags are predicted by spatial and temporal continuity to yield a predicted image, which 

10 predicted image is further used to detect tag points in a next-in-time image. 

It is an object of the invention to yield such a predicted image with sufficient information 
to allow an accurate detection of tag points. 

In accordance with the invention, an Image processing method to detect tag points in a 
current tagged image of a sequence of tagged images, comprises steps of : 

15 in the current image, estimating points having optimum intensity values in intensity 

profiles and labeling said points as candidate points of a tag ; using a previously constructed 
predicted image constituted of predicted tags determined from tags equations of a previous-in- 
time image of the sequence and from spatial and temporal parameters ; and, in the current 
Image, detecting tag points among said candidate points from said previously constructed 

20 predicted image ; determining tegs equations for the current image from said detected teg 

points ; using said tegs equations in the construction of a further predicted image for processing a 
next-in-time image of the sequence. 

The determination of an equation for each teg of each image of the sequence, that is a 
modeling of tegs, allows to woric with whole tegs, for example, whole lines, instead of points to 

25 estimate motions from one image to another. As, according to the invention, whole tegs are 
available, instead of only points on more or less interrupted straight or curved line, and as an 
equation of each teg Is known, it is possible to construct, by spatial and temporal continuity, a 
predicted image constituted of predicted tegs, for a next-in-time image, which predicted Image is 
rich of information since whole tegs positions are predicted. Moreover, knowing the likely positions 

30 of each teg as a whole altows to determine the belonging of a candidate point to a specific 
identified teg : an automatic tracking of tegs is consequentiy performed from an image to 
another, from the beginning of the sequence where the Identification of specific tegs Is easy from 
the end where motions of tegs render the identification harder. An other advantage of the 
algorithms working on whole tegs, according to the invention, is their fastness. 

35 In an embodiment, the method of the invention comprises steps of computation of 

equations of tags by using a Rational Rtting from the detected points. Said Rational Fitting can be 



used alone or in combination with a further fitting using a Residue Technique. The obtained 
detection is very accurate as this particular mathematical expression of tags allows a very good 
fitting to real tags, especially when tags are straight lines at the beginning of the sequence, and 
consequently allows to construct trustful predicted tags for next-ln*time images. 
5 In an embodiment, the method of the invention comprises steps to evaluate the belonging 

of a candidate point to a specific identified tag even when using a low temporal resolution. 
Effectively, the longer is the time between two images of the sequence, the larger is the motion of 
tags from an image to the following. Consequently, even when using modeling of tags according 
to the invention, there is a chance to select a point as belonging to a given tag although, in 
10 reality, this point is belonging to another appropriate tag. 

In an embodiment, the invention takes into account that the intensity profile of an MR 
image presents minimum of magnetization that are classically considered as constituting the tags, 
and maximum, less detectable than said minimum, that are generally very sharp, and that 
constitute another family of tags, labeled positive tags. Two tags corresporuling classically to a 
15 minimum of magnetization are always separated by a positive tag. Optimum points estimated by 
the image processing method of the invention include the points corresponding both to maximum 
and minimum values. The points corresponding to maximum values are especially well localized 
when working on CSPAMM protocol images as these images present a good contrast The method 
of the invention comprises steps to use the alternating pattern of these two kinds of tags and their 
20 spatial characteristics in order to detect tag points and in order to detennine with a great accuracy 
to which specific tag a point belongs. 

In an embodiment of the invention, the detection step using characteristics of the 
predicted image comprises sub-steps of ; 

distinguishing two kinds of tags : negative tags corresponding to minimum of 
25 magnetization and to a maximum of intensity in the intensity profile, and positive tags 
corresponding to maximum of magnetization and to a minimum of intensity in the intensity 
profile ; 

distinguishing two kinds of candidate points : candidate points being optimum value 
points corresponding to a maximum of intensity in the intensity profile, and candidate points being 
30 optimum value points corresponding to minimum of intensity ; 

selecting points of a negative tag D as being the candidate points corresponding to the 
maximum of intensity that are situated between the two predicted positive tags that surround the 
predicted negative tag that corresponds to the negative tag D, and 
symmetrically selecting the points of a positive tag. 
35 The delimitation of the region where tag points can be detected requires to use whole 

predicted tags, that is the main feature of the invention. This delimitation brings the advantage of 



criticaily reducing the chance to select a point belonging to a given tag of one kind to another tag 
of the same kind, what was current when classically using only negative tags. Moreover, the use 
of maximum value tags brings the advantage of providing more points than classical technique 
using only tags corresponding to minimum value of magnetization. Characteristk:s of the predicted 
5 image are consequently richer allowing a more accurate detection of tag points and a better 
tracking of the tags, especially in case of low temporal resolution. 

In an embodiment, the method comprises a step of automatically constructing a predicted 
image including sub-steps of choosing a given number of privileged points on tags of the 
previous-in-time image of the sequence ; calculating from positions of said privileged points in the 

10 previous-in-time image of the sequence, a predicted position of said privileged points ; 

constructing predicted tags of the predicted image from predicted positions of said privileged 
points. This last step can comprise sub-steps of estimating a minimizing function (f) that 
minimizes the distance between the predicted positions of privileged points and the result of the 
application of this minimizing function (f) to these privileged points ; applying the minimizing 

15 function (f) to tags equations of the previous-in-time image of the sequence to construct the tags 
of the predicted image. Said minimizing function (f) can be a function of similarity expressed as 
f(z)=lz+c, where I and c are complex parameters. 

In an advantageous embodiment of the invention, privileged points are intersection points 
between tag lines obtained from an MR image tagged on two distinct directions or between tag 

20 lines obtained from two MR images each tagged In one direction distinct from the tagging 

direction of the other, said two MR images corresponding to a similar step of the sequence. The 
intersection points are calculated from the two tag line equations. The use of this feature presents 
a particular advantage since these points are easily identifiable on every images of the sequence 
and, consequently, can be easily tracked from an image to another. 

25 By working on whole tags instead of working on points, the method of the invention 

allows a fast processing of images, since an algorithm working on whole tags knowing an equation 
for each of them is low resource consuming. Resource consumption can be further reduced by 
using an image segmentation, for separating region of interest from other regions where tag lines 
exist but do not provide information of interest 

30 The invention first allows a very reliable detection of tag points and consequentiy allows a 

good tracking of tags from an image of a sequence to another along the sequence. 

Brief E>escription of the Drawings 

The invention is described hereafter in detail, with reference to the schematic drawings 
35 wherein : 

Fig. 1 is a flow chart for illustrating a method of detecting tags ; 
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Fig. 2 is an intensity profile of an MR image in the modulation direction in the case of a 
one direction modulation of magnetization ; 

Fig. 3 is an example of a spatial condition used for selecting tag points ; 
Fig. 4a and Fig. 4b are two examples of MRI apparatus for carrying out the method of the 
5 invention. 



Detailed Description xsX the Embodiments 

RG. 1 is a flow chart that illustrates an image processing method according to the 
invention. On this diagram, processing steps are illustrated by oval blocks and the results of the 

10 processing steps are illustrated by rectangular blocks. 

Referring to FIG. 1, the image processing method has iterative steps applied to a 
sequence of tagged images for tracking tags on successive images of a sequence of MRI tagged 
images. According to this method, tag points are detected by using a predicted image constructed 
from, at least, the previous-in-time image. Then, the detected tag points are affected to a specific 

15 tag, said specific tag being consequentiy "tracked" from an image to the foltowing Image. 

An initialization step 11 is required as, for the first image of the sequence, at a first 
instant called time to, there is not any prevlousnn-time Image available to construct a predicted 
image. The first image of a sequence of tagged images is a non-deformed image presenting, for 
example, straight and parallel tags. These straight and parallel tags correspond to the case of one 

20 direction line modulation or grid pattern modulation that are preferred features for the invention. 
Consequentiy, the initialization step 11 constructs a first set of equations of tags T(tb-l) (12) at a 
previous instant called time (to -1) describing, for example, straight and parallel lines. This first set 
of equations is then used for constructing a predicted image serving for the detection of tag points 
of image at time tb. The method according tx> the inventton is effectively then implemented on a 

25 current image 10 at a current instant called time t of the sequence from tbto t^nd of the sequence/ which 
current image is denoted by image I(t). An estimation step 13 applied to said current image I(t) 
10 estimates optimum points denoted by CP(t) 14 and labeled Candidate Points. 

Then, a detection step 15 performs a detection of tag points denoted by TP(t) 16. This 
detection step 15 detects the tag points TP(t) 16 of the tags among the candidate points CP(t), 

30 using characteristics of a predicted image PI(t) 17 automatically determined by a construction step 
18 of the predicted image PI(t} 

In the construction step 18, the predicted image PI (t) is constituted of predicted tags, 
which are computed from tags equations 19 of, at least, a previous-in-time image of the sequence 
with respect to the time t of the current image and from spatial and temporal parameters, said 

35 tags equations being noted as T(t-1). This construction step 18 uses temporal parameters by 
using, at least, tags T(t-l) provided at an instant (t-1) 19 but can also use tags T(t-2) of an 




instant (t-2) and tags T(t-3) of an instant (t-3} 22 and so on as soon as these data are available 
fix>m the processing of images of the sequence. 

According to an advantageous embodiment of the invention, a spatial condition using the 
intensity gradient of the predicted image PI(t) 17 as a spatial parameter allows to discard the 
5 most part of contour points and noise. At each point of the predicted image PI(t) 17, an 

orientation angle, denoted by P(x,y), is given by the normal vector to the predicted tags. Mere 
interpolation techniques, such as bilinear interpolation, enables to compute this angle 0(x,y) for 
every point in the predicted image. A maximum error coefficient a (the same for every point) is 
attributed for p(x,y) in the whole image, said coeflFident a depending of the noise level of the real- 

10 world images. Candidate points selected using this spatial condition are the ones where the 

gradient direction lie in p(x,y) +/- ou This spatial condition application is used to discard the most I 
part of contour points and noise. Another spatial condition using the distance of a candidate point 
from predicted tags as a spatial parameter can be implemented, said distance being included 
within a given range or being function of positions of the predicted tags. 

15 In an example, spatial conditions on distance use the fact that, referring to FIG. 2, the { 

intensity J(x) profile in the modulation direction of an MR image tagged in one modulation 
direction x presents minimum value points m of magnetization that are classically considered as 
constituting the tags, here noted negative tags and maximum value points M, less stable than j 
minimum value points m that are generally very sharp. These maximum value points M constitute | 

20 another family of tags, labeled positive tags. Minimum value and maximum value points are 

characterized and, further localized, by cancellation of the derivative function. Using classical | 
image processing, maximum value points M can be distinguished from minimum value points m. ; 
Although maximum value lines are less detectable than minimum value ones, the use of maximum j 
value points allows to work on a narrower grid of tags as when using only minimum value points i 

25 as done classically. ; 
In an embodiment of the invention, an advantageous spatial condition on the distance of 
a candidate point from predicted tags of the predicted image can be implemented in order to use \ 
the predicted positive and negative tags and their alternating patterns, since two tags are always ^ 
separated by a positive tag, and vice versa. For example, as illustrated on FIG.3, the candidate j 

30 points corresponding to minimum intensity value and represented by a x and lying between j 

predicted tagsj3^ and D^^j , and near enough to predicted tag are assigned to tagD^ . 1 

Predicted entities are noted with a ^, This enables to affect the detected tag points to specific j 
tags without ambiguity whatever is the used tag pattern. This feature is especially interesting 
when the sequence is acquired with a tow temporal resolution. 
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Tag points 16, obtained after the tag point detection step 15, are used in a determination 
step 20 to determine the tags T(t) 21 of I(t) (FIG. 1). 



A technique of determination of the tag equations is proposed hereafter : In a preferred 
5 embodiment, a Numerical l^ional Approximation Algorithm is applied to calculate equation of 
tags from selected tag points. This approximation is a first "rigid" representation of tags In the 
space of rational functions with degree inferior to 4 and noted F/?^^^ These functions are able to 

Interpolate snxx)thly in informationless zones (typically inside the myocardium), far better than 
polynom-based interpolators. Given a set of p points {(xj, yi), i=l...p} labeled to a same tag, 
10 the best rational least square approximation on function y=f(x) can be computed to find : 

Inff^MJl:(ifi^i)-yif^\ 



Consequently the following iterative problem is introduced : 



J 



15 The discrete approximation of the two integrals by Riemann sums leads to a linear system In 
{aiybiY The convergence is rapidly observed in practice. 

In an advantageous embodiment, a second level of approximation is added, to locally 
compensate the error. Named "elastic" representation, this approximation use/^ that is a 
partition ( [x/, jc,+i i = l...n}of step 5 along the x-axis. On [jc,-, the residue Ri is 

20 expressed by the median of the error between a sample and the rational function. Then, the error 

is : 

r \ 



That is to say the convolution of the step-function (r^)^ by the centered gaussian of standard 
deviation a. E(x) simplifies in : 

Hence, the description space for tags equations is formally : 
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Equations found by this fitting allows to very closely fit to real tags. A trustful construction of the 
predicted image can then be realized. 



5 A predicted image constructton is ftjrther proposed hereafter : Tags T(t-l) are used in a 

predicted image construction step 18 (RG. 1), which uses the tags equations from at least the 
previous-in-time image, for the construction of a predicted image then used to process I(t) from a 
given sequence. 

In an embodiment of the invention, privileged points are chosen among points on the tags 
10 of at least a previous-in-time image. A predicted position of each of said privileged points for the 
time of the next-in-time image of the sequence is evaluated from positions of said privileged 
points on, at least, the previous-in-tinfie image. 

In an advantageous embodiment, tags are lines and equations of tags are known in two 
distinct directions, from an MRI image tagged on two distinct directions or from two MRI images, 
15 corresponding to similar times of the sequence. Each of the two MRI images is tagged In one 
direction distinct from the tagging direction of the other, and privileged points positions are 
calculated as being intersection points between tag lines in the two distinct directions. It is 
important to note that intersection points are advantageously used because they are easily 
identifiable on every images of the sequence and, consequently, can be easily tracked from an 
20 image to another. It is further important to note that when using intersection points while working 
with maximum and minimum magnetization tag lines, a very dense mesh of tag lines and a dense 
set of intersection points is obtained, enabling a very accurate determination of movements of tag 
lines. 

In an example, in order to calculate a predicted position for privileged points, the 
25 acceleration of privileged points is considered as being constant. The discrete scheme is then, for 
example, a third order linear filter : 

^i,j "^^hj ^^hj ' 

Predicted entities are noted with a ^ and, in this example, tag points from three previous-in-time 
images is used as soon as these three images are available. From the set of points obtained, 
30 predicted tags can be constructed by employing an approximation anruDng a spline function 
approximation or a rational approximation or any kind of Interpolation. 

In a preferred embodiment, the motion is constrained by estimating a function (f) that minimizes 
the distance between the predicted positions of privileged points and the result of the application 
of this function (0 to these privileged points and by applying the function (f) to tags equations of 
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the previous-in-time image of the sequence to construct the tags of the predicted image. For 
example, a similarity, transformation composed of a rotation, a translation and a scale change, 
expressed in the complex plane as : 

/(z)=;b + c, A, ce C 

5 is used to constrain the motion. The module of A gives the scale factor, while its argument is the 
rotation angle, c is the translation vector. In this form, the optimization of X and cin the sense of 

the least squares criterion, can be implemented by the pseudo-inverse method in -Mn(C) using 
the privileged points. The predicted tags are then computed by applying the/(>t,c) 
transformation to the former equations of tags of the previous-in-time image. 

10 Once the predicted image has been constructed, it can be provided to a tag points detection step 
15 (HG. 1) in order to select tag points of a next-in-time image. 

FIG. 4 illusb^ates the main features of an example of an MRI apparatus 30 to carry out the 
method as shown on Fig. 2. The MRI apparatus includes an acquiring system 31 to acquire data 
from a site of the body 32. Said data are provided to a processing system 33, generally included in 

15 the MRI apparatus 30 as illustrated on Fig. 4a. In a variant, this processing system 33 can be 
implemented in a computer 34, independent from the MRI apparatus 30 but in relation with It, as 
illustrated on Rg. 4b. The processing system 33 executes a set of instructions according to a 
prxjgram. The program causes the processing system 33 to carry out the method of the invention 
on data provided by the acquiring system 31. Said processing system 33 is in relation with a 

20 display equipment 35 to display processed data. 

The drawings and their description herein before illustrate rather than limit the invention 
because there are numerous ways of implementing functions by means of items of hardware or 
software, or both. In this respect, the drawings are very diagrammatic, each representing only 
one possible embodiment of the invention. Thus, although a drawing shows different functions as 

25 different blocks, this by no means excludes that a single item of hardware or software carries out 
several functions. Nor does it exclude that a function is carried out by an assembly of items of 
hardware or software, or both. Any reference sign in a claim should not be construed as limiting 
the claim. The word "comprising" does not exclude the presence of other elements or steps than 
those listed in a claim. The word "a" or "an" preceding an element or step does not exclude the 

30 presence of a plurality of such elements or steps. 
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CLAIMS 

1. The image processing method to detect tag points in a current tagged image of a 
sequence of tagged images, comprising the steps of: 

in the current image, estimating points having optimum intensity values In intensity 
profiles and labeling said points as candidate points of a tag; 
5 using a previously constructed predicted image constituted of predicted tags determined 

from tags equattons of a previous-in-time image of the sequence and from spatial and temporal 
parameters; and, 

in the current image, detecting tag points among said candidate points from said 
previously constructed predicted image; 
10 determining tags equations for the current image from said detected tag points; 

using said tags equations in the construction of a further predicted Image for processing a 
next-ln-time image of the sequence. 

2. The Image processing method of claim 1, wherein the tags equation determination step 
15 from detected tag points uses a rational fitting from the detected points, said rational fitting being 

used alone or in combination with a further fitting using a Residue Technique. 

3. The image processing method of one of claims 1 and 2, wherein the detection step from 
said previously constructed predicted image, comprising the sub-steps of: 

20 distinguishing two kinds of tags : negative tags corresponding to minimum of 

magnetization and to a maximum of intensity in the intensity profile, and positive tags 
corresponding to maximum of magnetization and to a minimum of intensity in the intensity profile; 

distinguishing two kinds of candidate points : candidate points being optimum value 
points corresponding to a maximum of intensity in the Intensity profile, and candidate points being 
25 optimum value points corresponding to minimum of intensity; 

selecting points of a negative tag D as being the candidate points corresponding to the 
maximum of intensity that are situated between the two predicted positive tags that surround the 
predicted negative tag that corresponds to the negative tag D, and 

symmetrically selecting the points of a positive tag, 

30 

4. The image processing method of one of one of claims 1 to 3, wherein the step of 
constructing a predicted image comprises sub-steps of: 

choosing a given number of privileged points on tags of the previous-in-time image of the 
sequence; 




iPrihtea^;03^Q8>2Ojb;i 



u 

calculating from positions of said privileged points on, at least, the previous-in-time image 
of the sequence, a predicted position of said privileged points; and 

constructing predicted tags of the predicted image from predicted positions of said 
privileged points. 

5 

5. The image processing method of claim 4, wherein the step of constructing predicted tags 
from predicted positions of said privileged points comprises sub-steps of: 

estimating a function (f) that minimizes the distance between the predicted positions of 
privileged points and the result of the application of this function f to these privileged points; 
10 applying said function (f) to tags equations of the previous-in-time image of the sequence 

to construct the predicted tags of the predicted image. 

6. The image processing method of claim 5, wherein the function (f) is a similarity expressed 
as f(z)=lz+c, where I and c are complex parameters. 

15 

7. The image processing method of one of claims 4 to 6, wherein privileged points are 
intersection points between tags obtained from an MRI image tagged in a grid pattern on two 
distinct directions or between tags obtained from two MRI images each tagged in a straight and 
parallel lines pattern in one direction distinct from the tagging direction of the other, said two MRI 

20 images corresponding to a similar step of the sequence, said intersection points being calculated 
from the tags equations. 



8, The processing method of one of Claims 1 to 7, to be applied to, at least, a sequence of 
MRI tagged images, to track tags on successive images of the sequence, comprising steps of: 

25 initializing the processing method by implement one of the method of claims 1 to 7 for the 

first image of the sequence, using a first predicted image representing the non-deformed 
modulation pattern; 

iteratively implementing the image processing method of one of the claims 1 to 7 for the 
following images of the sequence. 

30 

9. A computer program product comprising a set of instructions for carrying out one of the 
methods as claimed in claim 1 to 8. 



10. A system for processing images of a sequence of MRI tagged images, comprising: 
35 Means for detecting tag points of these images according a method as claimed in one of 

Claims 1 to 8; 



i 



31-10-2000 



12 



Means for displaying the results as a succession of images wherein tags are visible. 
An MRI apparatus comprising: 

Means for acquiring sequences of MRI images from a site within a body; 
Processing means Including a system as claimed in claim 10. 
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